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Abstract o 

o 

The present invention relates to a virtual reality 
system for displaying panoramic images, which comprises an 
image data storage means 71; a panoramic image storage 
means 73; a panoramic image generation means 72 for 
receiving image data divided in several frames from the 
image data storage means 71, storing them in the panoramic 
image storage means 7 3 in order of row, and generating a 
panoramic image; a 3-D graphic processing block 75 or 7 6 
for reading from the panoramic image storage means 7 3 the 
image data of a frame the that corresponds to the view 
point of a user, rendering and texture-mapping, and 
outputting RGB image signals; a signal converter 12-1 or 
12-2 for converting the RGB outputs of the 3-D graphic 
processing block into TV image signals; a HMD (Head Mount 
Display) 2 3 for receiving the outputs of the signal 
converter and displaying them as well as detecting the 
movement of the user; a position and direction tracker 11 
for receiving the movement signals of the user from the HMD 
and computing out the position and direction of the user; a 
vision angle computing block 78 for computing out the view 
volume of the panoramic image according to the movement of 
the user inputted from the position and direction tracker 
and outputting it to the 3-D graphic processing block. 
This invention displays panoramic images naturally 
according to the viewpoint of a user in the virtual reality 
system. 
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B ElkBI^ 01 Dl XI (panoramic image)M CI^MeilOloPI m^M±^0{\ 5^!^^. GilOlEi XH §^4^&(71 )3f Efi:^e}°' 

oloixi XH§4^&(73).^oi Giioiei x-1 s^e(7i )s - a o^^^yw9^ HBiigjo^ QioieiM ei^^^of ->o^ a^:?,' li^L^ei^ 

OIOIXI X-J§4^B(73)0il X-iSmo^ OlOIXIM ^^5H^^ OlOIXI ^^4^B(72). MgXfSJ A|g01l {m\ Qimm^ s^ n^UgJEl"^ 

^^□ioia# mteie" oioixi x-iS4^e(73)g^a i.'CH2f gL>cH^' ^ oesaioi rgbs^^ai^m m^o\^ sx^m n^mx^zi^ds 76) 

. ^ 3xf^ □EH^xHdl^oi RGB^^e TVS^^<M^^ ^^SF^ <M^^a^:?l(1 2-1 .1 2-2). <m^^^:?|oj ^a.^ o'^^^Oh Cir^M£iIO|§,^:Qf O^^S-j 

A^gx^°^ g^-g,'^ ^xtm^ hmd(23). HMD^¥a Afgxfsi e^i,'<Msg 2^^^o\ Aigxtsi ^ ^^mm^ ^ ^^e^ 

1). ^|xt ^ ^^ot ^5j:i|(ii)^-Ei Afgx^2i g^gjoii ©e^ Efin^am,- oioixi°j ^ mmp <y#moi ^^^^i st}^ d8h^ xH£1¥(75 76) 

S ^^oF^ AlO^a,^ ^16}¥(78)^ ^^£j01 SiU. CCfEtA] ^^^^ ^ ^' A| Oil A^ AfgX}£j A|S(view point)01l [Qdf (panoramic) OIOIXI 
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£ 4a.4b^ ^^'A|:::^iiO]lAi B ^'^0\\ CQdf Dlbi£te« OIDIXIS ^^3}^ ?H^g SAlo[ 

£ 5^ ^ i^^soii ufiiia^o' oioixis ^^of^= ^^^m ^m^L, 
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S^T^f^Bi'IJi^^ni^^^^^ "^^'"^ system)01l Sg} ^og. sg, mtEiej 01 01 II (panoramic image)S a^SaiOI3i:)| ?^s^ :,ja; 

g£i :ji4}S4'(vr)s 3»a2i A(§sJS(:)f4}Aii3ii)i AfsiK)ii:>ii MissiOi xfijoi :)f&'Aii3)i 0011 01^ ^^i^ :)iA,a^,o)| uau^ 

Ji\Em:>\ (HS^S a^Et Xflgg ?fsSf:HI oj:i| OUgOII a§}/°l§f sai ^^aTk oo^s^=oTo^^A^ atrii 
st AHSS Algg SSI? 4- 2ig :j|m=iD. ' ' °^ ^ =. c u =. ^ u« a-i ut 

Oiasj 3F&»Sfe'(VR)g afe agoil CD£> ^ffe-SSCVirtual Environment). IK (Virtual Presence), oj S All 3)1 (ArtKlcal World). ?\^M\mVulu 

al World). AtOI W>iiHI 01 i (Cyberspace) a gOIS ggSHI 2i°U. ^gf^jog g = a3| gigoiy! fe'All3(ia ^A|si 3X}^ :?l&'AiM|s Al 
§1)011311 mSoHi. □ 3)fefAIMI2) fe'AISioe lt°S3n SSfSf ^ Sife a^4-B3) AISJ)2| 55,^011 C«§S|01 fe'H|5Joi S^,^! HIS8)= iJ^' 
?ll?f(Sensory feedback)4=Ss UlSSfSSW eJS^joj jflgi!} ggg If 4^ sH^fe 3IS0ie} f.' 4^ ojq ° 

PC3IS.^2I 0I§& AI^BS £ 1011 EAIE! tiiSl fe'OI. £|g£iEI SL'SKreallty englne)3f S2) 

&'^:'l{effector)S ^^9Q. SE& £|g£|EI 2!!5!S PCgSEI ^x^l&^0^| VGA3£HaiaE nn 30 DEH^'es I||2 30 HEH^'eE 3 

D A|gc eE. ejEliBIOI^eH. SdJSM. SlSCI^iB. CPU. g gJ3). mi 3D DeHSieSSI RGB Ms.m NTSC?^^'°I TVAJSS ':N^m^'nii 
<yaSS:3|(12-1). III2 3D Zia|5iaH2| RGB NTSCgf<!^i°J TV<MSS a2»5ft HI2 <ii§a&3|(12-2) VGAD2HmaHS¥E) o-'^S 

gfe»S SAIoffe VGA2Ua(14). H1 1 (!JSff &3|(12-l)e¥H S^jg SAto)fe NTSC2UEI(13). ?\X\ ^ g^Sf ^2j3|(11) SsV^ 

9 CI . 

Z1£I2. S2)&^a:J|b AtSIOt 3)4}Sfe'°) AIMIB AIS2|og.gg3,:,| o,g^ j,,^ ofSElE CI;!:MaiOI(HMD:23)a $ai:,|(22) 50I>: 
S,'(21) m°S. OIPOIH °iI2. HMD(23)fe E 2011 SA|g SOI. AISDSi Oi£|g}ifg S#g|3l ^SJ i!!/H(24) S!fll§gS HISoPI 
:iini9i(25). U^MaiOloH ^fe 5)^^ LCD(27). SSfai2(2e) SS SgJSm 2iQ. 

012) a'S AligOllAi A|gXf°| m£| gS-oig $<m:i|(21). a!AJ(24). a- ^XlgfSf ^5^31(1 1)011 °|5H ^^iSIOI £|g£IEI wixiog ois^g^ 
S£IEI enas A|gD£l m£l gsiaoil OE) 2E!§e} A|§01IAI°) S&^g mStlQ. EEII AfgD^ SOI^^ g2) o|sskm"3P 
^A||3)|2) 2iE)ffl|0|:il» 4^ oip ° 1= ui^ofm 

□ aCII OI£-)S} 3^&^ S^AIi&'OllAI HIS3fe gAfg oiDI §oH5! 3f&^g^'oj gAjs A)gD£| AlgOII Ea£) XH^^oH^fe §E°I 32^ 
as bJS3f2) Eficyej OlOllKpanoramic image)fe HICHS S^oH ^11 SSIfe gHlgOj 2iQ. - 

^. 3)4iS^'2| CI:i:geilO| 4=0O£ Alggfe LCDU CRT g°l SAIgxIfe blCiegS) gif ^ gSf^E §21 Hl&og ^a, 680 x 480 
£ 010111°) 33|3f Hl*fa3| ragOII lDt£)aj 0I0III2) SOI DH^ S)eg §J:i»eOII HAj6H2fI| =SQ (0£fA) SEHOII 3)fe» sj^-ai^e^. 
0!|/H IDiiL£)°i OIOIXIB HIS8)?I ?loHAHfe £ 3a gJ 3b0j| £EAIE! Hf2) SOI. ^4'3H°I Haigjos ^^S! mt£fej OIOIIIB =>X)'«2S 
§aiO| oH^2J3| (fflgOII S)S°| g5,'S0| S5f:ia?4 A)gJ) AIS°J 0|§3) Sfe>s)S2J UIgOl SXISUI Solfe SHIgOl SIP. 

^'SOI 01^:21} S)fe 3mi 

OlOil H &'gS feO|2) SS gHISg oHi^iol^l ?|ol01 0)£^3H°I Hai&'og UVOiS! S&^S WamOj o)U3 E|££f9^ OIOIIIS ^^812! 01 
S A|§°| OlgOII (D£).X)3>:e^3)| Cl^gaiOloH g 4= S ^^'Al^gg HigS)feCll □ =SJ0| °IQ. 

^D\9l Sg essf3| ?|8f01 S fe^gg. 01£I3H°J HaiSoS 9^ HiojE^S S^S='Oi OiuiAlS $SS5H?^ n)t£)°i 

0!G!I! ^S4-£!; ii?! -asa lift£}e- 0|D|X|§ HS8H2 2ife ]!)££)&! AtglfS) A|§Oil 0£) CHg8)& sJ HaiSSI S&H3I0IEIS 

fef3| Il)t£)°! OlOIII H§4=92£¥ei S!0i2) ejCliJ g,' i!|>i?4 QHSSIOI RGBS4}6.iaS S^olb 3aS! □e«S!XH£|^; Afj, g^j^ ^^u, 
XH£I¥2| RGBg^g TVS&<yaS ^&6}fe <iiSSg»3l: &'3I <ysa5f3|°| S^g gJ^g^O) a±mS\Q\mDi 0)ga Atglfoi gxio.a 
8)fe Sfe»SA| gsjg,' 4=B: &'3| S&^SAI g5,'S ^m^B°^^B AfgX)°| eS!°'6iS§ gj^g>0) AlglfSJ ?|X| i!'g/ste°>^ 

sife ?ixi a; as ^2?:)i: gy feoi ^xi ai sif ^5!3I£¥ei gj^a AigDsi g^jgioii msi mtEiaj oioixi°i s msm <ysoioi *i3i ssT 
a zieHaieEs g^sffe Aio)2i 3ii(y¥S sest^ ae ^sog 

i?S2| ^« s ^g 

ois). g¥S! see ifssioi s me^iej ^'aioiim daiioi ggof3i£ t^p. 

£ 3a. 3b& 3)&' ©A./^i^gOj,^ gg^jo, gfAiog ii(££|o. Cli^iSaiOIS ?So)fe 3Hg£0II2. £ 4a. 4bfe 3tfe» S&'A|ig!0«A1 S a'gOII 
(DEI il}££)ei OlOIIIg aS8f& 3HgS £A|& £30101. £ 5fe g gfgOII dSi nj££)5i 0101X11 iSSSffe giSS £A|St og£0|Q. 

5 3g gfSoia. eeHOllfe SaOII £AI@ his) SOI Sa. Sb. Sc 33«2J Haia(2| ^aiaS 640x 480°J SJ^'S 0IP01SPI2 3|§«tQ)0£ 01^ 

01a mtEia- sfeiois. 01 Hais§°i qioiej^ sboti £aie 0)2} SOI. UICI2 g&»oii 2>2> =?ssioi usao) 2ia. 

^. Sa HaiaS al^EJ a4B07)tXI°J SQIOIEIS OI^OIX) 2!:n. OlS QIOIElfe bICIS g&'Oll a1¥E1 a480WXI XHSaOl 9111 Sb 

°aiSS b1¥H b480JIXI2l SaiOIElS OI^OIXI SiD. Olg aiOIEIfe UICI2 g&'OII b1¥EJ £X}5!£S b480WXI USaOl °!£01 Sc 531 

as ci^Ei c480fl}xia saioias oi^oixj 2^001. ois aioiE)^ uipe m&ow ci^a ^xisjog c480wxi usaoi 2^0 
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oia ifg flftaiaj gAjoi gEHs, :)iA,g^Ai^gonA) ci^^^saioia s^oii^ Sasia. sbsfs. s^;sa ^a^jos o^._ s^ naic. si 
es> ci^saioig:*! ousoii it^o, oigoi --e^^^rfta. oiiaa. msxjsi aisoi sasaog^ Kbssoa xHAisi otii sasilj 
^^^'^a sbsias s^a'¥3j g>5^sbaa°s oieaaot sju §aioiife sasiaoi^ibiD^t ?ixij\ sb§»aoi ub-'^i qh^oh ai 

^ ^^"^ saiaog sfsg ^ 4aa fe'oi muai ^ch^ saisc^. mtei9< oioixn SD)°e ^^s^ 

AfgJFSI A|§(viewpoint)0|| (D£J CHgotfe S&'QIOiaS ^SofOi e? SaiSSJ gfe^QIOIHg g^StOl Cl^gaiOimS^ of°ejW Al^^Oil 

5;.^,!/L^'°' ^^"^ = - a480. b1. b2 b480. c1. c2. ... c480 H§@ g 

fe'QIOiag a1. b1. c1. a2. b2. c2. ... a480. b480. c480 ^SS X1§§tQ. 

ei^. ofu°j Hai&'oi nJH2i gog oi^oixm mum mic^sj oioixpj whsj Haia°s oi^oia ^^ms. t.^Al3^ =0.5,3,1 

Oia ^^01 nDWm gog oi^CHS! k 3H2I Haigjog 6fU°J iUtBS,' OIOIXIB ^SSffe g ^►gOil CDg gf^g E 5011 EAI§ ma SOI I^l 1 

xt^jos i{CHa HI2 ffliaaioti nsmoi mt£t5> oioixis asetD. 

£ 50IIA1 2:?|-2tB31l(100)01IA1t naig. 34. jg S:>|S}3f3. ^-^B:>il(101)01IA1fe i Haiasi jS QlOiag »I1 OIISdl^^R 

i^cM22. »gte3ii(io2)oii/dfe i^'ois i Haig>' is Qioiag MI2 ffliaai&^oii ^xf^jo^ xisma. 

o\oiM Haigj^-f' iS ig:>ui?.i ^(io3) ez^ja saigf^^' Df oma^ naiejgjs kep an as^ qs saiaa 8Ht«soii ch 
8H feoi (101)^' JH§B3ii(io2)s a}^o>3. m^is saiss 4= otxiei naigjgjs kep as, ps soil chshai &»:3i ass y 

s:>(a Haias 4= di otxiaf saisas ksp as ss4- js i§^iai3ii)(io5), saia i » is s^iss ^ g:j|a |h«i- n^ oi 
aS SSSpoorf tsasoii chsh fe^:?i =gBsi(ioi) xisB5ji(io2m ^^moin. Pf ofxio^ g^s ksp 

01a fe^g ass ^^§iJ\\ ggg H12 oiiaaioiife musi mteie,' oioixpi xHsgjii ap. 

tie. E 6S s a^goii (a£f mteje- oidixib ci^Maioim:ii jm^om. £ 7g s &soii mEi nitaf^- oioixis p±saioispi ?i 

si :>\^' S^'Al^goj :?g£0ID1. £ 8S £ 7011 £Aia AI0t2i 3j|<if^£| :)|fe S^^EOIP. 

s gfAi ^gs bia SOI oiua mtsfsi omixia s^s^ Aigx}°i Aigoii ojdf sHgsife sa aioiaa ^gsioi smsi 2^.0, 

r 

£ S£ofS. P4-3H2) HaigJ(...Sn-1. Sn. Sn+1...)OI olU°l mic^ai OjOjXIS aS&SS asas&'°l UI^OII OHSAI?! A|s 

XfBI AlgOII mSi 6H&£lfe S&v QIOIEiS ^SotOj P^BaiOISH ^£^ 20IP. ^. AISXIS^H r&g 1^015! SgSHSI U|o^OII Sn- 
^ Sn, Sn+1 S Ol^Oia S&tfiOl PBP AfS»:»l HMD(23)» iiinAH D|£iaj gflfg gEIS OlOll PSf IllicSie,! gAfo) XJ^i^iapji SAia 

oia SOI m^di°i oiDixiB p^gaioi 5ii^:?i 9\m s wsow ms £ 7011 £Aia ma &01, cpu(74). s4»ciioia xis^ 

(71), EltEtej OlOIXI as:?|(72). mtei^i OIOIXI Xi§¥(73). XIII 30aai5iaH(75), fli2 3DaBH5je£(76) 30 S5f*iai¥(77) AIOP^ 

?^l<:L^¥(78). ?ixi sj g^if ^2i:?i(ii). tjsa€»:'i(i2-i). X112 <ysas»:3i(i2-2), hmd(23). ^<m:)|(22). gj^§xi(2i) g2s ?aap. 

ai^aia e!l5!°l Sj^OI £lfeCPU(74)i= .>SS°J H^ngg 4-S5fC1 Al>:gg ^'d,^6rb M?! V«S4iSS HlOIStS. Sfe^ QlOia X^§¥(71) 

Wife oiapHsi Haia2s ^sa g^f aioiagoi xiggoi sip. oiais? aioip xis¥(7i)Sfe sie p^^a ^s}o\^(hdd) am 
a2?i5j§xi§oi oi§g 4^ oip. ^ 

fflteje,' 0101 XI ^&D\{72)^ 2 5011 £Aia ma se Aia^g 4-Soioi c-iioia xH§¥(7i)oii saigi^s ?g£joi x^§a s^'e sjoi 
a mteiaj oioixi xh§¥(73)oii ^xm^s ^§§101 mu°i iift£j°^ oioixis ^bs&p. peiAi mtysj oioixi x^§¥(73)o^lfe mtB 
e,' OIOIXI Qioip:?! xisaoi siP. / - ^ « 

mi 3Daai5ia2(75)fc mtsiai oioixi x)§¥(73)oii xisa aioiagoiiAi Aiof2> 3)it(¥(78)£¥a gj^afe ai§xioi Aig(view poinOiJ 
.soil (D5i. Aigoii cHgsife s^aioias i.'oia saiae ggsioi 2^ RGBSfe'tiss mmmji. «i2 so aais!e2(76)fe mtatej oiqi 
XI x^§¥(73)oll X4§a aioiaeoiiAH Aiot2i 3)i6?¥(78)S¥a gj^a^ Aigxi°i ai s (view point) <ysoii ma} aisoii aigoii s^jaioia 

Oira. SaS! D2HSI0IIAI IlftSfo^ OlOIXIB A|gS§}0{| C:HgA|9|3i ?l6HAife S!?IS2gf(cylindrical)a Sfi^ LH^Oll mtets,' OIOIXIS iSr^: 
#J OHSdexture mapping)?} ^. A|§XI 3)l£°) g^iSOll mej OHffl ^ Sg(viewvolume)g TWi^SAM SHSafe aioiaeis ^S/SAIsfP. 

OlS £|ol01 AISXI°J CH£l(head)giSfS HMD(23)LHa ii'AIOII Bim SXiaoi ?lxl iJ Sgf ^5!:)|(1 1 )0I| Ai gJifOI 3fi<yap. 

Aiof2f 5iii}¥(78)fe £ 8011 £Aia ms soi. 91x1 gfgf ^£!:?i(n)S¥a a^afe Af§xt°i gsjuiysoii ma aisxi S!I£°i 2,»£ 9g> 

5il<i^e^ ^. OlOll DOe} Pi:SaiOI&' Sis- sa^g fll6}ol2, S ^ Sejeojl Sim aSlgS PliLfSIOl AHSS S aoiMS ^§3(3 OlOil 
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e M^om, ^ mm ^16^^(86)- AH^ ^gg ^ 50.^011 (GBI « M e (view volume) g O^l^^O, ^-iv.ewpomt) 

^•^§xi(2i)b A}gij:)i y\M ^^M\M0{\ ^^m ^om WQ^ 2°^. 501^^. d}^±, GioiEi eoi oig^ ^ o,q 

HMD Ul^Oil 22J 24)D\ Olg ^AtaK)t ^ ^^D\(U)^ A,^g S^efP ^ ^m^^DHuT^ - 

Aigoii me} anesife Qioiaeie ^gsfoi naiss ^ ci^MeiioioH ^b^am ^^M±mmM Mmj}2i Aiscview poinooii m^} 

nib^e^ej (panoramic) OlOlXIM Xf3::b:g:Hl CI^^McilOloH m ^ 2.1^ ^31-:'f 

(57) S^£| 
1. 

QIOlEi X-i§^B(71): 
mteie^ OlOIXI X-i§4^&(73); 

QIOlEi X-i^^^B(71)^^EH OIEH^HHI MBl!^'^^ QIOIEiS ^^mo\ ^gj^ a^, n^i^e^g. o|D|I| X-i§^^(73) 

Oil XiSofOi Efii^dfo' OlOIXIM ^^oH^^ niii^af^ OlOIXI ^^4^^(72): 

Aigoii CHem^ of Heiigi°j g^^aioiE-is min^f^ oiqixi x-iS4^B(73)^^&i g^oisf eiicH^i ^ uw^mcn rgb« 
M^m^ 3X^^ □eH^xHai^(75.76); 

3x}s zieH^'xHai¥2j rgb^^# tv^^^^iI^^ ^^^i^:?i(i2-i.i2-2): 

>ii^^^:>i£i m^m 2^^^o^ a±m^\o\min o\m^^ A^gx^sj g^gj^ sxioj^ s^^hai ^ 

^oi ^ixi ^^£i:?l(11)^-E^ o.^g Mgxf°j e^gjoii cnd^ oioixisi ^ <^L^^5f01 ^oi stm mw^ xHei¥(75 76)^ 

M^m^ Aiot2| )iiA|^(78)^ ^^E! oiQixiM c\±mmm^\ 9\m m^M±m. 

S^ll 2. 

liME^Oll 2i01/d, E[inaf°,' OlOIXl ^^4^&(72)0| 

n:)H°j oi^oi^i k:'H2i Heii^'oi xHse aioia XHS^(7i)^^Bi xin ^eiig<°j x-in ly^E^ x-iik Haig.'2i xiin ^?}fxi ^e^^^o^ 

^Xf^o^ 0,0^2^ A^:,, nti^^g. oioixi XH§,^¥(73)0il XH§8F^ >!e ^SE^ o^^ OiOIXIM Cir^^MeilOl 6PI :j^Af ^A.;7^e. 

S^iJ3. 

:qi1i>^0|l °iOiAH, A|0^2j l\\t:^^(7Q)D\ 

^Oil P^eeiiOl^^ ^^i^g ^!<ifof^ ^^ir ^I6f¥(82). ^ ^£oiM2^ 5,.^- ti^^i^^ l^M^i^ ?f6^^-(S4): :?r'^r¥(64 

)2J ^^CH! rnPt lu^g ^ '^=ei5r^ ^ ii^M ^^¥(85); AH^ ^ SoiMOil [^£1 ^ MMg >^!<^l^o^^ ^ :*1I6^¥(86)^ 

4. 
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71 



ill 

^ill 3D 
2 eH ^' ^ ^ 



12-2 



Ail 2 

^ 7| 



76 



^il2 3D 
n EH ?L,i ^ ^ 



77 



A] 5| ^ 



X 



73 









□ 1 A| 




Ah ^ 



72 



n( 






□ 1 A| 











71 



Ai ^ 




2000/10/12 



9 




WIPS PIView 



82 



84 



7^1 A I- ^ 




^85 


^85 












S ¥ 




7i| ¥ 





30 



83 



2000710/12 



10 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 



□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: ■ 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




BLURRED OR ILLEGIBLE TEXT OR DRAWING 



